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(54) Apparatus and method for automated voice analysis In ACD silent call monitoring 



(57) A method and system for automated silent call 
monitoring in an automatic call distributor (ACD) envi- 
ronment includes configuring (34) a set of call perform- 
ance profiles which include voice data patterns which 
are descriptive of voice data transmissions during an 
ACD call and which are associated with substandard 
agent performance. Each voice data pattern has a cor- 
responding threshold which represents the maximum 
number of detections tolerated in an ACD call prior to 
execution (50) of a notification routine. A digital signal 
processor (22) (DSP) monitors (40) a first call between 
an agent terminal (10) and a customer terminal (12) for 
the voice data patterns and stores (42) detection data 
in memory (26) upon detecting of one of the voice data 
patterns. A central processor unit (30) (CPU) compares 
the number of detections of the voice patterns within 
predetermined time intervals to the threshold numbers 
of detections represented in the thresholds to determine 
(44) if any threshold has been exceeded. If no thresh- 
olds have been exceeded, the DSP continues to monitor 
for the voice data patterns. If a threshold has been ex- 
ceeded, the CPU executes the notification routine 
wherein a supervisor terminal (14) and the agent termi- 
nal are notified of the exceeded threshold. A supervisor 
notification can include an option to establish (52) a di- 
rect monitoring session for the first call and an option to 



transfer (56) the first call to the supervisor terminal. An 
agent notification preferably includes call performance 
analysis which provides suggestions for improving call 
performance which are responsive to the detected voice 
data patterns. 
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(54) Apparatus and method for automated voice analysis In ACD silent call monitoring 



(57) A method and system for auto mated silent call 
monitoring in an automatic call distributor (ACDj envi- 
ronment includes configuring (34) a set of cali perform- 
ance profiles which include voice data patterns which 
are descriptive of voice data transmissions during an 
ACD call and which are associated with substandard 
agent performance. Each voice data pattern has a cor- 
responding threshold which represents the maximum 
number of detections tolerated in an ACD call prior to 
execution (50) of a notification routine: A digital signal 
processor (22) (DSP) monitors (40) a first call between 
an agent terminal (10) and a customer terminal (12) for 
the voice data patterns and stores (42) detection data in 
memory (26) upon detecting of one of the voice data 
patterns. A central processor unit (30) (CPU) compares 
the number of detections of the voice patterns within 
predetermined time intervals to the threshold numbers 
of detections represented in the thresholds to determine 
(44) if any threshold has been exceeded. If no thresh- 
olds have been exceeded, the DSP continues to moni- 
tor for the voice data patterns. If a threshold has been 
exceeded, the CPU executes the notification routine 
wherein a supervisor terminal (14) and the agent termi- 
nal are notified of the exceeded threshold. A supervisor 
notification can include an option to establish (52) a 
direct monitoring session for the first call and an option 
to transfer (56) the first call to the supervisor terminal. 
An agent notification preferably includes call perform- 



ance analysis which provides suggestions for improving 
call performance which are responsive to the. detected 
voice data patterns. 




FIG. 2 
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Description 

BACKGROUND OF THE INVENTION 



[0001] The present invention relates generally to 
methods and systerhs for ACD silent call monitoring 
and, more particularly/the invention relates to a method 
and system for ACD silent call monitoring utilizing auto- 
mated voice analysis. 

[0002] ACD systems are employed in a wide range of 
customer service environments and provide ACD users 
with an economical and powerful means for providing 
customer service. Calls can be automatically routed to 
ACD agents who possess the skills required for a partic- 
ular call. Management of a customer service: depart- 
ment is facilitated by the ability of a manager or 
supervisor to monitor calls directed to agents and to 
analyze performance of the agents. The supervisor, uti- 
lizing a single terminal, is able to conveniently switch 
between different ACD agent calls and thereby directly 
monitor the job performance of a large number of ACD 
agents. "■' ,;."- ,w ' • ■ 

[0003] An example of an ACD system for providing 
customer support for computers and peripheral devices 
might include a greeting which requires the customer to 
select from among computer related questions regard- 
ing, printer malfunctions, an inability to run particular 
applications on the computer; and software installation 
problems: The option which the customer selects 
■■; causes the ACD system to transfer the call to a particu- 
lar agent whose skills match the needs of the customer, 
as indicated by the selection. Once the call has been 
answered by an ACD agent, a supervisor can silently 
monitor the call to evaluate the agent's performance 
and make recommendations. ;; - 
[0004] If the ACD supervisor becomes familiar with 
the ACD agents whom the supervisor oversees, the 
supervisor is able to allocate his time effectively by 
spending a majority of time on those ACD agents whose 
skills require more development and spending less time 
supervising those ACD agents whose skills are already 
refined. However, if an ACD supervisor is hot familiar 
with the ACD agents he supervises, either because of 
high agent turnover or because^ he is new to the job, the 
supervisor does not have the proper information to 
focus attention on those ACD agents who most urgently 
require it. Consequently, the supervisor wastes time 
monitoring agents who do not require supervision, while 
agents who urgently require supervision do not receive 
the attention they require. 

[0005] A partial solution to the above described prob- 
lem is provided in U.S. Patent No. 5,737,405 to 
Dezonno, which describes an apparatus and method for 
detecting conversational interruptions in an ACD sys- 
tem, wherein the system includes a detection circuit for 
detecting when an agent and a customer are concomi- 
tantly talking during an incoming call. A caller audio sig- 
nal detector detects customer audio signals 



representative of caller speech and an agent audio sig- 
nal detector detects agent audio signals representative 
of agent speech. When the caller audio signal detector 
and the agent audio signal detector detect speech sig- 
5 nals simultaneously; an interruption has occurred. Infor- 
mation regarding the interruptions is provided to a 
supervisor via a supervisor terminal and/or the agent 
via an agent terminal. The interruption information is 
presented by showing the agent identification, total call 
10 time, agent talk time, and the number of interruptions. 
Alternatively, the information is presented by showing 
the averages of total call time, agent talk time, and num- 
bers of interruptions. 

[0006] Detecting interruptions in incoming ACD calls 
is provides a measure of insight into the performance of 
an ACD agent. However, there are numerous other indi- 
cia which provide a more complete description of agent 
performance during an incoming call. Furthermore, the 
Dezonno invention provides for transmitting notification 
20 of interruptions to the agent and supervisor terminals as 
they occur without any processing of the interruption 
data, or after the call is terminated in the form of a call 
report which represents the interruption data in a procr 
essed format. An ACD supervisor might not be able to 
25 effectively utilize the call interruption information in an 
unprocessed format during the cail. Either the supervi- 
sor receives unprocessed call interruption data from 
numerous calls about agent interruptions as they occur, 
which can easily become overwhelming, or the supervi- 
se sor receives processed data after the call is terminated, 
which is obviously too late for the supervisor to utilize 
during the call. 

[0007] What is needed is a method and system for 
providing automated ACD call monitoring which enables 
35 a supervisor to utilize information generated by the 
monitoring during the pendency of the call and which 
provides a more complete description of agent perform- 
ance than is currently available. 



40 SUMMARY OF THE INVENTION 

[0008] A method and system for silent ACD call mon- 
itoring utilizing automated voice analysis includes iden- 
tifying multiple voice data patterns associated with 
45 substandard agent performance, monitoring a first call 
between an ACD agent terminal and a customer termi- 
nal to detect the voice patterns, determining whether 
the number of occurrences of any one of the voice data 
patterns exceeds an associated predetermined thresh- 
so old, and notifying the agent terminal and/or a supervisor 
terminal upon detecting that a threshold number of 
voice data pattern occurrences has been exceeded. 
[0009] In a preferred embodiment, the invention is 
practiced in an ACD system wherein incoming calls 
55 from customers are routed to multiple ACD agents. The 
monitoring of the first call can be performed at any one 
of multiple sites, including the agent terminal, the super- 
visor terminal, or another location which has access to 
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: both agent voice data and customer voice data. t: • 
[0010] 1 A processor, such as a digital signal processor 
(QSP), is utilized to detect the voice data patterns i asso- 
ciated w^ 

1 patterns include a length of silence in conversation 
between the custbmer and the agent in'vexfcess' of a pre- 
" determined length which ihcticates ieitKer' poor informa- 
tion delivery by the agfeht or lack of interest 6n the part 
of the customer. A conversation volume above a maxi- 
mum volume level tends to indicate a high* frustration 
level in either the "customer or the agent Changes in 
voice frequency in excess of a predetermined range 
during the conversation terid to indicate an emotional 
exchange: The average length of 'continuous conversa- 
tion by the agent alsoj provides information, about agent 
call performance. If the average length of continuous 
agent conversatbh is above ifmaxi mum threshold, this 
tends to demonstrate that the agent is talking without 
paying sufficient attention to the customer. If the aver- 
age length of continuous agehr conversation is below a 
minimum threshold; this tends to show that the agent is 
not being responsive io the customer. Interruptions in 
cbnversatbn -te'nd: to indicate poor agent performance 
as well. An interruption of the agent by the customer 
: demonstrates that the customer is frustrated and dissat- 
isfied with the agent's responses, while interruptions by 
the agent 'demonstrate mat the agent is; being impatient 
arid not listening to the customer; 
[001 1 J Memory stores voice data pattern thresholds 
associated with the voice data patterns, such that each 
voice data pattern has a corresponding threshold. A 
threshold identifies a. maximum number of occurrences 
of a corresponding voice i data pattern which is tolerated , 
during me first call between theagent and the customer. 
The thresholds caa be configured to permit a predeter- 
mined number bf occurrences for any given time interval 
during the first call and the number of occurrences per-, 
mitted by thresholds associated with different voice pat- 
terns can differ. For example, the threshold number of 
agent interruptions per five-minute interval might be 
greater than the threshold number of occurrences of 
agent speech having volume above a predetermined 
level. ■■• 

[0012] The number of occurrences of the voice data 
patterns are recorded by a counting device, the function 45 
of which can be performed by the DSP or a central 
processing unit (CPU). The number of detected occur- 
rences of the voice data patterns is compared to the 
corresponding thresholds to determine whether any of 
the voice data patterns have been detected in excess of so 
the corresponding threshold number of times. The com- 
parison function can also be performed by either the 
DSP or the CPU. Upon discovering a voice data pattern 
which has been detected in excess of a threshold 
number of times, the CPU or DSP executes a notifica- 55 
tion routine to provide notification to the supervisor ter- 
minal and the agent terminal. 

[0013] The monitoring of the first call for voice data 



patterns can occur at a different location : from where the 
threshold comparisons take place. For example, the 
monitoring might take place at the agent terminal which 
. transmits each.detection to the supervisor, terminal.. The 
5 supervisor terminal calculates the total , number of 
occurrences and determines whether, any thresholds 
have been exceeded.,, When one of the thresholds is 
exceeded, the. supervisor CPU causes a notification to 
be displayed on the supervisor terminal. The CPU can 
w be configured to cause the notification device to include 
an option^to establish a^direct silent monitoring session 
with the agent terminal under specific circumstances. 
For example, if the agent's performance; is poor, the 
notification can include an option to the supervisor to 
is establish a direct rnpnitpring sessjon. the. notification 
can also include an option to transfer the call from the 
agent terminal to the supervisor terminal if the agent's 
performance is determined to be particularly poor. 
[001 4] The* notification rputine can also provide notifi- 
20 cation to the agent terminal In a preferred embodiment, 
the agent notification takes the .form of. performance 
analysis data which pertains to a detected voice pat- 
tern.- For example, if the agent has; interrupted, the cus- 
tomer in excess ofa threshold number. of times, a 
25 message is displayed on the agent terminal i which says 
"Avoid interrupting the customer,**. Alternatively the mes- 
sage can simply inform the agent of the number of times 
that the agent has interrupted the customer! 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] : v 

Fig. 1 is a block diagram of an ACD system in a 
35 telephony-oyer-LAN (TOL) environment in which 
the automated silent call monitoring system of the 
present invention operates. 

Fig: 2 is a block diagram of the automated silent call 
monitoring system embodied in a gateway shown in 
4o Fig. 1. 

Fig. 3 is a process flow of a method for performing 
silent call monitoring according to the present 
invention^ 

DETAILED DESCRIPTION 

[0016] With reference to Fig. 1 , an ACD system which 
employs an automated silent call monitoring system of 
the present invention includes an ACD gateway 16 con- 
nected to first and second agent terminals 10 and 12 
and a supervisor terminal 14^ The first and second 
agent terminals and the supervisor terminal are located 
on a data network such as a local area network (LAN), 
and each terminal is enabled for telephony-over-LAN. 
The gateway enables the first and second agent termi- 
nals 10 and 12 and the supervisor terminal 14 to estab- 
lish telephonic connections to communication devices 
on other communications networks, such as an inte- 



EP 0 9.81 237 A2 



grated services digital network (ISDN) telephone 20 
connected to the gateway 16 via an ISDN 1 8. Although 
Rg 1 shows the present invention operating in a teleph- 
ony-over-LAN^ based ACD, system, a person familiar 
with the art will recognize that the automated silent call 5 
monitoring system can operate within a private branch 
exchange (PBX) or a conventional stand-alone ACD 
system: - ' : ' • :•-«>■■.».-■■ 

rooiT] The gateway 16 routes incoming calls to avail- 
able agent terminals i 0 and 1 2. Although only two ACD w 
agent terminals are shown in Fig. 1, the AGD system 
can accommodate more agent terminals. Typically, the 
number of agent terminals is substantially greater in an 
ACD system than the number of supervisor terminals 

14 Thec^ab'lV toa ^ matteal ^ mon ' to " 
voice data patterns associated with poor agent perform- 
ance enables a supervisor to efficiently monitor a large 
number of ACD agents by focusing attention on those 
ACD agents whd most urgently require supervision. 
[0018] Referring to Fig. 2, the gateway 16 of the auto- 20 
mated silent call monitoring system includes a LAN card 
24 to enable communication between the first and sec- 
ond agent terminals 10 and 12 and the supervisor ter- 
minal 14. A basic rate interface (BRI) card 32 enables 
communication between the ISDN phone 20 and the 25 
first agent terminal 1 0, the second agent terminal 1 2 
and the supervisor terminal 14. A digital signal proces- 
sor (DSP) 22 analyzes agent voice data transmitted 
from either the first 10 or second agent terminal 12 and 
, analyzes customer voice data transmitted from the 30 

ISDN phone 20 to detect the voice data patterns asso- 
■:■ dated with poor-customer service. The calculation proc- 
: essor 28, the comparison processor 30, and the DSP 
22 have been illustrated in Fig. 2 as separate devices for 
purposes of clarity. However, the functions of all three 35 
can be incorporated into a single processor. 
[0019] The voice data patterns include a length of 
silence in conversation between an agent and customer 
exceeding a predetermined time interval which tends to 

indicate that the agent is not providing efficient delivery 40 
of information. A volume level of the conversation above 
a predetermined level and fluctuations in voice fre- 
quency outside of a predetermined range both tend to 
indicate a high level of frustration in the agent, the cus- 
tomer, or both; An average continuous interval of agent 45 
conversation in excess of a predetermined interval 
tends to indicate that the agent is talking excessively 
and not engaging the customer, whereas an average 
continuous length of conversation below a minimum 
interval tends to indicate that the agent is not respond- so 
ing effectively to the customer and that the customer is 
having to work too hard to get information out of the 
agent. Excessive interruptions by the customer can indi- 
cate that the agent is not giving the customer sufficient 
opportunities to talk during the conversation, whereas ss 
excessive interruptions by the agent tend to indicate 
that the agent is being impatient and rude with the cus- 
tomer. 



[0020] When the DSP 22 detects one of the voice data 
patterns, the DSP enters data representing the detec- 
tion into memory 26. The calculation processor 28 
accesses the detection data and updates the calcula- 
tion of the number of detections that have occurred in an 
ACD call during a predetermined time interval. The pre- 
determined time interval can be configured differently 
for each type of voice data pattern, For example, the cal- 
culation processor might calculate the total number of 
customer interruptions by the agent within a five-mmute 
interval, whereas the total number of detections of 
occurrences of a voice exceeding the predetermined 
volume level might be calculated over a ten-minute 
interval. Logically, the more urgent the defection of a 
particular voice pattern is, the smaller the interval will be 
over which the number of detections is calculated, 
because a number of threshold detections for the more 
urgent voice pattern will be more quickly identified at the 
outset of the call. For example, detection of voice vol- 
umes over a certain high volume level indicates that 
communication in the call has severely deteriorated 
such that a single detection might require urgent atten- 
tion. The time interval associated with such an event 
might be as short as 10 seconds. 
[0021] After the calculation processor 28 updates the 
number of detections of a voice pattern, the comparison 
processor 30 accesses threshold data from memory 26 
to determine whether a threshold number of detections 
has been exceeded. The parameters of the voice data 
pattern thresholds can be configured according to the 
requirements of the system user. For example, the toler- 
ance for interruptions for a technical support agent will 
most likely be higher than for a catalog sales agent 
because the technical support agent might be required 
to direct the conversation to a greater extent than the 
catalog sales agent. The comparison processor 30 
compares the number of detections of the voice data 
pattern with the threshold number of detections indi- 
cated by the threshold data corresponding to that voice 
data pattern. If the comparison processor 30 deter- 
mines the threshold has been exceeded, it causes a 
notification routine to be executed to provide notification 
" to the supervisor terminal 14 and one of the agent ter- 
minals 10 and 12. 

[0022] Although the automated silent call monitoring 
is shown in Fig. 2 as being performed in the gateway, it 
can be performed at the agent terminals 1 0 and 12. the 
gateway 16, the supervisor terminal 14, or the monitor- 
ing can be distributed amongst these devices. For 
example the DSP 22 can be located in the agent termi- 
nal where it monitors a call to the ISDN phone 20 for the 
voice data patterns, tf the DSP detects a voice data pat- 
tern, it can transmit data representative of the detection 
to the supervisor terminal 14, where it is entered into 
memory 26. The calculation processor 28 and the com- 
parison processor 30, located in the supervisor termi- 
nal process the detection data to determine if the 
corresponding voice data pattern threshold has been 
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■ exceeded.- * /' ^ -. v ■ ^ ;- w: ' • 

[0023j The location of the monitoring can . also be 
dynamically altered during a call between one of the 
agent teVminals^^O^ and : 1 2 kn^ ' the ISDN phprie 20. 
Wherever' the alternated *^ 5 
the monitoring location' shdiiid have access to both the 
agent voice. data and the customer voice data. If the first 
a^eht terminal 10 and the ISQN phone 20 are con- 
nected over a first, call, the agent terminal' might initially 
perform the entire automated monitoring process. If 10 
demands on the/ first' agent terminal's processor 
resources increase to an extent that. the agent terminal 
can no longer continue to perform the automated moni- 
toring; the agent voice data, the customer voice, data, 
and the" monitdrihg session data; can \ be transmitted to 1 5 
the supervisor terminal 14 or the gateway 16, where the 
monitoring session can be cbhtinued. ;: 
[0024] f he DSP 22 monitors for simultaneously trans- 
mitted agent voice data and customer voice data to 
detect interruptions during calls between one of the 20 
agent terminals 10 and 12 and the ISDN phone 20. 
Simultaneous transmission of agent voice-data and cus- 
tomer voice data indicates an interraptabn has occurred. 
More specifically, the DSP can determine which of the 
two parties is tne interrupting: party: by determining 25 
whether the agent voice data wasi cp trans- 
mitted prior to! simultaneous transmission of customer 
voice or whether the customer; voioe data was continu- 
ously transmitted prior to sirrw 

agent voice data. The DSP 22 monitors the pitch of the 30 
agent's voice in agent voice data and the customer's 
voice in customer voice data to determine whether a 
fluctuation outside of a predetermined .frequency range 
;■ occurs. Trie DSP 22 also separately monitors the agent 
voice data and the customer voice data for speech vol- 35 
ume and the overage time interval of continuous speech 
to determine whether the speech volume or the contin- 
uous speech interval are outside of predetermined 
ranges. ' 

[0025] Separately monitoring agent voice data and 40 
customer voice data for voice patterns is important 
because a particular Voice pattern can have different . 
meanings depending on whether the voice pattern was 
detected in the agent voice data or the customer voice 
data. Detection of customer voice data above a prede- 45 
termined threshold might be more readily tolerated than 
detection of agent voice data over the same predeter- 
mined threshold: For example, if the ACD is setup to 
provide customer technical support, the customers are 
often irate at the outset of the call as a result of the tech- so 
nical problem for which they are calling. The threshold 
number of occurrences of the customer speaking at a 
volume above the predetermined volume level might be 
relatively higher than the threshold number of occur- 
rences of the agent speaking above the predetermined 55 
volume level. 

[0026] When a voice data pattern has been detected 
in excess of the threshold number of times, the supervi- 



sor terminal 14 is notified of the event. The. comparison 
processor 30 accesses supervisor notification data from 
memory 26 for transmission to the supervisor terminal. 
The notification can be. in the form of. a message, dis.-, 
played on a monitor ,p\ the supervisor terminal, reflect- 
ing detection of the voice data pattern in excess of the, 
threshold number of occurrences. The notification can 
also include an option to the supervisor to establish a 
direct monitoring session, so. that the supervisor, can 
directly monitor the agent's performance for the remain- 
der of the call.. The comparison processor can be con- 
figured to provide the supervisor terminal with an option 
to transfer the first call from the first agent terminal 1 0 to 
the supervisor terminal 14, if the automated monitoring 
session indicates that the agent's call performance is 
particularly poor. For instance, if the agent is. yelling at 
the customer and interrupting the customer as well, the 
message might include an option to transfer the call 
from the first agent terminal 10 to the supervisor termi- 
nal 14. : ; ■•. ./,:...- '. . ; . ... . 

[0027] The comparison processor 30 can also beacon- 
figured to access agent notification data. from memory 
26 for presentation at the one of the agent terminals 1 0 
and. 1 2 in response to detecting occurrences of a voice 
data pattern i ^excess of the threshold number of times. 
The agent notification can simply indicate the call per- 
formance error. associated with the voice data pattern, 
or it can include, call performance analysis which pro- 
vides suggestions for the agent to improve the agent's 
call performance. For example,, if the agent has inter- 
rupted the customer in excess of the. threshold number 
of times* the notification might be in the form of a mes- 
sage on the agent terminal's monitor that says "Avoid 
interrupting the customer." .... .. 

[0028] Referring to Figs. 2 and 3, a method for auto- 
mated silent call monitoring includes the step 34 of con- 
figuring call performance profiles. ... Each call 
performance profile includes a voice data pattern which 
is descriptive of a characteristic of poor agent service 
during an ACD call with a customer, and at least one 
corresponding voice data pattern threshold which repre- 
sents the maximum number of times the voice data pat- 
tern may be detected within a predetermined time 
interval before a notification procedure will be executed. 
Some call performance profiles might include two voice 
data pattern thresholds, including an . agent threshold 
and a customer threshold. The voice data patterns 
include interruption in conversation by the agent and the 
customer, speech by the agent or the customer in 
excess of a predetermined volume level, fluctuations in 
the pitch of the voice of the customer or the agent in 
excess of a predetermined range, intervals of silence in 
the conversation in excess of a predetermined interval, 
and intervals of continuous agent or customer speech in 
excess of a maximum interval and below a minimum 
interval. 

[0029] In step 36, agent notification messages are 
configured which will be presented at the agent terminal 
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upon detection of one of the voice ! data patterns in 
excess of the threshold number of times. The agent 
notification messages preferably contain call perform- 
ance analysis data prdviolngsu 
agent : call perforrnanc& - ^ . y >->:•' 5 

[0030] In step 38, a first -ciil is es'febifsh^'-bf^^n 3 
first ACD agent terminal 10 and a customer phone 20. A 
DSP 22 monitors the first call in step 40 to detect any of 
the voice data patterns and in step 42, the DSP records 
detected voice data patterns into memory 26. In step 10 
44, a comparison processor 30 determines whether the 
number Of recorded - voice data patter n defections for 
any of the voice data patterns exceeds a threshold. If no 
threshold is exceeded, the call continues to be moni- 
tored in step 40. The comparison processor 30 can also is 
be configured to ''cbmpa^'fhevhUnibe'r-bf wto data pat- 
tern detections between multiple calls "to 4 determine 
which call requires more urgent attention. For example, 
if a second call were established between the second 
agent terminal 12 and a second ISDN phone (not 20 
shown), the' DSP 22 would simultaneously monitor both 
calls. If a threshold number of detections occurred in 
both the first and second calls; the co^ 
sor 30 can be configured to compare- the nu mbe r of 
detections In the first and second calls to determine 25 
which call requires more urgent attention. The specific 
types of voice data patterns that were detected in the 
first and second calls can also be : considered in deter- 
mining which call requires inore urgent attention. • 
[0031] If a threshold number of detections Is exceeded so 
for any of the voice data patterns, in step 50 a notifica- 
tion routine is executed. The notification routine 
includes- presenting a message at a supervisor terminal 
14 which reflects detection of the threshold number of 
voice pattern occurrences in the first call. The message 35 
can also include art option to establish a direct monitor- 
ing session between the first agent terminal 10 and the 
supervisor terminal 14 and art option to transfer the call 
from the first agent terminal to the supervisor terminal. 
The notification routine further includes presenting a 40 
notification message at the agent terminal 10. The 
agent notification message includes call performance 
analysis data which includes suggestions for improving 
agent call performance. 

[0032] In step 52, the direct monitoring session is 45 
established between the supervisor terminal 14 and the 
first agent terminal 10, if the supervisor elects the option 
to establish the direct monitoring session in response to 
the supervisor notification. During the monitoring ses- 
sion, the agent voice data and the customer voice data so 
are transmitted to the supervisor terminal and the 
supervisor is able to provide suggestions for improving 
the agent call performance, either through written mes- 
sages transmitted to the agent terminal or verbal com- 
ments transmitted to the agent in the monitoring 55 
session. Neither the written messages nor the verbal 
comments are transmitted to the customer in the call 
between the agent and the customer. In step 54, a 



determination is made whether the supervisor has 
elected to have the first call transferred to the supervisor 
terminal. If the supervisor has chosen the transfer 
option, In step 56 the call is transferred to the supervisor 
terminal 1 4: If the call transfer option has not been 
selected, the first call continues to be monitored: for the 
voice data patterns. / ' 

Claims 

1 . A method for automated silent call monitoring utiliz- 
ing automated analysis of speech characteristics 
comprising the steps of: 

configuring (34) call performance profiles rep- 
resentative of a plurality of voice patterns, with 
each said voice pattern being associated with a 
predetermined threshold number of occur- 
rences;- ■ 

monitoring (40) a first call between an agent at 
an agent terminal (10) and a customer at a cus- 
tomer terminal (1 2) for occurrences of said plu- 
rality of voice patterns duri rig a conversation 
between said agent and said customer; 
maintaining (42) a record of a number of occur- 
rences for each of said voice patterns during 
said conversation; * 
determining (44) whether a number of occur- 
rences of a particular one of said voice patterns 
exceeds said predetermined threshold number 
associated with said particular one; and 
initiating (50) a notification routine upon detect- 
ing said number of occurrences exceeding said- 
predetermined threshold number. . 

2. The method of claim 1 wherein said step of monitor- 
ing (40) said first call for said plurality of voice pat- 
terns includes monitoring said first call for at least 
one of a voice signal transmitted over said first call 
representative of speech having a volume which 
exceeds a predetermined volume level, an interval 
of silence between transmissions of speech over 
said first call which exceeds a predetermined 
silence interval, an interval of continuous agent 
speech length below a minimum interval, a continu- 
ous agent speech length above a maximum inter- 
val, and a fluctuation in pitch of speech which 
exceeds a predetermined fluctuation range. 

3. The method of claim 1 or 2 further comprising the 
step of configuring (36) a response for each of said 
plurality of voice patterns, each response includes 
call performance analysis data associated with a 
corresponding voice pattern, said step of initiating 
(50) said notification routine including transmitting 
one of said responses to said agent terminal (1 0). 

4. The method of claim 1, 2, or 3 wherein said moni- 
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toring step (40) includes monitoring a plurality of 8. 
calls, the method further comprising the step of. 
comparing first call voice pattern occurrences with 
^ second ca\t voice pattern occurrences to determine:, 
which of said first call and said second call requires ..... 5 . • . 
more urgent supervision. - 



■•; y - - : ! '; " • ■ ' • 9. 

5 The method of claim 1 , 2, 3, or 4 wherein said initi- 
ating step (50) includes providing notification to -a 
supervisor terminal (14) together with an option to io 
establish (52) a silent call monitoring session at 
said supervisor terminal for directly monitoring said 
: -first call. • . . 

6. A system for performing silent call monitoring utiliz- is 
ing automated voice pattern detection to monitor a 
first call between an agent at ah agent terminal (10) 10. 
and a customer at a custodier terminal (12) in an 
1 -automatic call distributor (ACD) environment cpnv 
-prising: • , yi- ; \ ; . 20 

: voice monitoring circuitry (16) for ; detecting 
• ; : v/ substandard performance of an agent user qf 
♦ : • said agent terminal during said first call, said 

voice monitoring circuitry comprising!- % ■ ' 25 



a) a digital signal processor (22). for detect- 
ing (38) a plurality of voice data patterns 
associated with said substandard perform-, 
ance of said agent;: • 

b) memory (26) including voice data pat- 
tern thresholds corresponding to said 
voice data patterns such that each voice . 
data pattern has a corresponding thresh- 
old;-. 

c) a comparison processor (30) for com- 
paring (44) a total number of detected 
occurrences of a voice data pattern to a 
corresponding threshold; and 



30 . 



35 



40 



a transceiver (24) for providing notification (50) 
upon -detection of a number of said occur- 
rences of one of said voice data patterns which 
is in excess of said corresponding threshold of 
said one. 



The system of claim 6 or 7 wherein said compari- 
son processor. (30) is configured to compare (44) 
said total number of detected occurrences within a 
predetermine, time interval to said corresponding 
threshold. J. 

The system of claim 6,. 7, or 8 wherein said memory 
(22) further includes call performance analysis data 
associated with said voice data patterns such that 
each voice data pattern has associated call per- 
. formance analysis data, said transceiver (24) being 
configured to present said call performance analy- 
sis data at said agent terminal upon detection of 
occurrences in excess of said threshold number of 
{voice data pattern occurrences. 

The system of claim 6, 7, 8, or 9 wherein said voice 
mo n rto ring circuitry (16) is configured to simultane- 
ously detect (40) substandard performance of a 
•plurality agents, said comparison processor (30) 
being further configured to compare (44) detected 
occurrences of said voice data patterns in said, first 
call with detected occurrences of said voice data, 
patterns in a second call to determine a relative 
urgency associated with said first and said second 
calls; i . 



45 



7. The system of claim 6 wherein said digital signal 
processor (22) is configured to detect at least one 
of a length of silence in conversation between said 
agent and said customer in excess of a predeter- so 
mined time interval, a conversation volume in 
excess of a predetermined volume level, voice fre- 
quency changes in excess of a predetermined fluc- 
tuation range, a continuous agent conversation 
interval above a maximum interval, a length of con- 55 
tinuous agent conversation below a minimum 
length. 
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